Deep Learning Attention

Back to Home

01. Introduction to Attention
02. Sequence to Sequence Recap
03. Encoding -- Attention Overview
04. Decoding -- Attention Overview
05. Attention Overview
06. Attention Encoder
07. Attention Decoder
08. Attention Encoder & Decoder
09. Bahdanau and Luong Attention
10. Multiplicative Attention
11. Additive Attention
12. Additive and Multiplicative Attention
13. Computer Vision Applications
14. NLP Application: Google Neural Machine Translation
15. Other Attention Methods
16. The Transformer and Self-Attention
17. Notebook: Attention Basics
18. [SOLUTION]: Attention Basics
19. Outro

Back to Home

15. Other Attention Methods

11 Other Attention Methods V2

Paper: Attention Is All You Need

Talk: Attention is all you need attentional neural network models – Łukasz Kaiser

udacimak v1.3.0